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ABSTRACT 

This work presents generalized low-rank signal decompositions with 
the aid of switching techniques and adaptive algorithms, which do 
not require eigen-decompositions, for space-time adaptive process- 
ing. A generalized scheme is proposed to compute low-rank signal 
decompositions by imposing suitable constraints on the filtering and 
by performing iterations between the computed subspace and the 
low-rank filter. An alternating optimization strategy based on recur- 
sive least squares algorithms is presented along with switching and 
iterations to cost-effectively compute the bases of the decomposition 
and the low-rank filter. An application to space-time interference 
suppression in DS-CDMA systems is considered. Simulations show 
that the proposed scheme and algorithms obtain significant gains in 
performance over previously reported low-rank schemes. 

Index Terms — Low-rank modelling, adaptive algorithms, alter- 
nating optimization, switched systems, interference suppression. 

1. INTRODUCTION 

Low-rank signal processing is an area that is central for dealing with 
high-dimensional data, low-sample support situations and large opti- 
mization problems that has gained considerable attention in the last 
decades (T][2l. The origins of low-rank modelling and signal pro- 
cessing lie in the problem of feature selection encountered in statis- 
tical signal processing, which refers to a dimensionality reduction 
process whereby a data space is transformed into a feature space |2|. 
The fundamental idea is to devise a decomposition that performs di- 
mensionality reduction so that the data vector can be represented by 
a reduced number of effective features and yet retain most of the in- 
trinsic information content of the input data |2|. The goal is to find 
an appropriate trade-off between model bias and variance in a cost- 
effective way, yielding a reconstruction error as small as desired. 

Prior work has shown that low-rank adaptive filters ||3]-||9] are 
cost-effective techniques for modelling a number of practical prob- 
lems in acoustics, communications, radar and sonar, and for dealing 
with large filters and situations of short data records. Several low- 
rank adaptive filtering methods have been proposed in the last decade 
or so |3|-|9|. Among these techniques are eigen-decomposition tech- 
niques 1 3 1, the multistage Wiener filter (MSWF) |4|, the auxiliary 
vector filtering (AVF) algorithm |5|, the interpolated reduced-rank 
filters |6|, the reduced-rank filters based on joint and iterative opti- 
mization (JIO) |8| and joint iterative interpolation, decimation, and 
filtering (JIDF) |9|. Key problems with previously reported low-rank 
adaptive schemes are the modelling of certain low-rank signals and 
the design of multichannel processing schemes |3|-|9|. Low-rank 
signals that exhibit highly correlated statistical features and operate 
in the presence of high-power signals (eg. jamming signals) con- 
stitute a challenge for existing methods. Moreover, most available 
methods require either separate structures for multichannel process- 
ing L9J or exhibit high complexity ||5ll4l. 



In this work, a generalized scheme is devised to compute low- 
rank signal decompositions with switching techniques and adaptive 
algorithms, without the need for eigen-decompositions. The pro- 
posed generalized low-rank decomposition with switching (GLRDS) 
scheme computes the subspace and the low-rank filter that best match 
the problem of interest with very fast convergence speed and low 
complexity. By imposing constraints on the decomposition and per- 
forming iterations between the computed subspace and the low-rank 
filter, the proposed GLRDS scheme obtains smaller reconstruction 
errors than existing methods. In order to compute the parameters re- 
quired in the signal decomposition and the low-rank filter, an alter- 
nating optimization strategy based on recursive least squares (RLS) 
algorithms is presented along with switching and iterations to cost- 
effectively compute them. Unlike existing schemes, the GLRDS ef- 
ficiently lends itself to multichannel processing. An application to 
space-time interference suppression in DS-CDMA systems is con- 
sidered. Simulations show that the GLRDS scheme and algorithms 
obtain significant gains in performance over existing schemes. 

The paper is organized as follows. Section 2 formulates the 
problem. Section 3 presents the proposed GLRDS scheme and least 
squares (LS) design. Section 4 presents the alternating optimization 
strategy along with recursive algorithms. Section 5 presents and dis- 
cusses the simulation results and Section 6 draws the conclusions. 



2. PROBLEM STATEMENT 

In this section, the fundamental ideas of low-rank signal process- 
ing are presented. The main design problems for a decomposition 
that performs dimensionality reduction are discussed. An approach 
based on linear algebra and a linear signal model, which is suffi- 
ciently general to account for numerous applications and topics, is 
adopted. Consider the following linear signal model at time instant 
i with A/ samples organized in a vector as given by 



r[i]= Hs[i]+n[i], i = 1,2, 



(1) 



where r [i] is the M x 1 observed signal vector with the M samples 
to be processed, H is the A/ x Af matrix that describes the mixing 
nature of the model, s[i] is the A/ x 1 signal vector that is generated 
by a given source, n[i] is an M x 1 vector of noise samples, and P 
is the number of observed signal vectors or the data record size. 
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Fig. 1. Block diagram with the stages of low-rank signal processing. 



In low-rank signal processing, the main idea is to process the 
observed signal r[i] in two stages, as illustrated in Fig. [T] The first 
stage coiTesponds to the dimensionality reduction, whereas the sec- 
ond is responsible for the signal processing in a lower-dimensional 
subspace. The dimensionality reduction is performed by a mapping 
represented by a decomposition matrix Sd = [si . . . Sd ■ ■ ■ sd] 
with dimensions M x D, where D is the rank (D < M) that projects 
r[i] onto a D x 1 reduced-dimension data vector ro [i] and Sd is the 
dth column of Sd- This relationship is expressed by 



vdW 



5gr[z] 



E 



H r., 

Sd r\i\qd, 



(2) 



where q^ is a D x 1 vector with a one in the dth position and zeros 
elsewhere, (■)"^ and (■)^ denote transpose and Hermitian transpose, 
respectively. Key design criteria for the matrix Sd and the dimen- 
sionality reduction are the reconstruction error, the computational 
complexity and the compression ratio CR = MjD. These parame- 
ters usually depend on the application and the design requirements. 
After the dimensionality reduction, an algorithm is used to per- 
form the signal processing task on the reduced-dimension observed 
vector rD[i] according to the designer's aims. The resulting scheme 
with D elements shall benefit from a reduced number of parameters, 
which may lead to lower complexity, smaller requirements for stor- 
age, faster convergence and superior tracking capability. In the case 
of filtering by a D x iiT matrix W d ~ [wd,i wd,2 ■ ■ ■ ivd,!], we 
have the following output A' x 1 vector estimate 



d=l 
K D 



(3) 



We consider low-rank algorithms with the aid of linear design tech- 
niques. In order to process r[i] with low-rank techniques, we need 
to solve the mean-square error (MSE)-based optimization problem 

[S D, opt, Wd. opt] = arg min _B[||a;[i] - "M^cSurfz]!]^] , (4) 

where x [i] is the desired signal and E[-] stands for the expected value 
operator. The optimal solution WD.opt of the problem in (|4j is ob- 
tained by fixing Sd , taking the gradient terms of the argument with 
respect to W*d and equating them to a zero matrix which yields 
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(5) 



where .R = E[r[i]r^\i]] = SdRSd is the D x D low-rank corre- 
lation matrix, it = _E [r [i] r ^ [ j] ] is the M xM full-rank coiTelation 
matrix, P = i?[r[j]a;^[z]] = S%P is \h& D x K cross-coiTelation 
matrix of the low-rank model. The associated MMSE for a rank-D 
matrix filter is expressed by 



MMSE: 
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(6) 



where (7^ = _B[ja;^[i]a;[i]p] andtr[-] stands for trace. The optimal 
solution Sd, opt of the problem in (|4j is obtained by fixing lynfi], 
taking the gradient terms of the associated MMSE in (|6} with respect 
to S*D and equating them to a zero matrix. Considering the eigen- 
decomposition of R = $A$^, where $ is an M x M unitary 
matrix with the eigenvectors of R and A is an M x M diagonal 
matrix with the eigenvalues of R in decreasing order, we have 



'D,opt — 
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(7) 



where ^i.m.i-.d is a M x D unitary matrix that corresponds to 
the signal subspace and contains the D eigenvectors associated with 
the D largest eigenvalues of the unitary matrix $. In our notation, 
the subscript represents the number of components in each dimen- 
sion. For example, the M x D matrix ^i:m,i:D contains the D first 
columns of $, where each column has AI elements. 

The previous development suggests that the central element for 
constructing low-rank techniques is the design of Sd since the MMSE 
in l[6j depends on P, R and Sd ■ The quantities P and R are com- 
mon to both low-rank and full-rank designs, however, the matrix 
Sd plays a key role in the dimensionality reduction and in the per- 
foiTnance. In what follows, a cost-effective scheme for computing 
Sd, Wd, opt and the remaining statistical quantities is presented. 

3. PROPOSED GLRDS SCHEME AND LS DESIGN 
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Fig. 2. Proposed GLRDS scheme. 



The idea of the proposed GLRDS scheme, shown in Fig. 2, 
is to introduce constraints in the decomposition matrix Sd to sub- 
stantially reduce the number of parameters for filtering. Since this 
usually affects the reconstruction error of the algorithm, a switching 
mechanism is incorporated to provide the Sd matrix with alternative 
bases. Similar ideas have been reported in the literature of automatic 
control and, more specifically, in the area of switched control tech- 
niques I11II12I . Consider the following vector estimate: 



d=l 
D 



(8) 



= ^dW( ^q^d^fcCr-H ]SdAA, 



where dd,b[i] is the M x \ shaping vector employed to mould the 
dth column of the matrix So^tfi] which is expressed as 



dd,i,W = [0 



1 



(9) 



and 6=1, . . . , B is the index of parallel switching branches. 
The quantity 7^ is the number of zeros chosen according to a given 
design criterion. In this work, we use patterns created by 7^ = 
{j — 1) [A'f/DJ + (b ~ 1) due to their simplicity and satisfactory 
performance. These patterns lead to Id x 1 basis vectors Sd,b[i\- 
The Al X Id matrices Ca^ ^ [i] and Cr [i] are Hankel matrices with 



shifted versions of Sd,b[i] and r[i] described by 



Cr.[i\ = 



.W 



[i] 



'Id 






(10) 



In or- 



A similar structure to the above can be obtained for Cg^ ^ [i]. 
der to design the GLRDS scheme, the parameters Id, D and B must 
be chosen, and the filters Sd,b [i\ and W d [i] need to be computed by 
solving the optimization problem 
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(11) 



B. 



Fixing Wd [i] and solving the problem for Sd,b [i], we obtain 



Sd,b\i] = Rdl[i\{Pd,b\i] -5Z^j,6Wsj,bW), 



JT^d 



(12) 



d,j = 1, 



where i?d,4i] = Y:Ui>'"''ldWD[i\WEli\qdC^ll]dd,bd^,bC*r.[l] 

andP,,6[i] = J2l^,y-'qfWD[i\WE\i]qdC^ll]dd,bdf^bC'r.[l] 
are Id x Id correlation matrices, and the Id x 1 vector p^ j, [i] = 

^l^i y^' x^ [l]W'^[i]q^C'^ [l]dd^b is a cross-correlation vector 

Once the Sd,b[i] are computed, we can build the corresponding 
decomposition matrix SD,b[i]- According to the schematic in Fig. |2l 
a selection is performed among the B available matrices as follows 
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(17) 



Pj,b[i\ = X~^P,,b[i-l]+qfWD[i\W'^[i\q^Cl[i\dd,bdf,bC*M 



Pd.bl'i] = XPd,b[^ - 1] + a;^[i]Vrf [i]q^C^[i]dd,( 



(18) 
(19) 



With the s 



(t)[ 



we can build the corresponding decomposition ma- 



trix S^ jj[i] and perform the pattern selection as follows 
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, (20) 



After the selection of the decomposition matrix, we can construct 



ro [i] = So.b, [i\r[i\ and compute the filter W)^' [i + 1] 



H^«[i + 1] 



WD[i\+kD[i\e''^'\i] 



where e'*'[i] — x[i] — xj^ [i] and 



kn\i] = 



X-^PD[i-l]rD[i 



{l + \-WH[i\Po[i-l]rD\i]' 



(21) 



(22) 



Poli] = \-'Pd[i - 1] - \-^kD\i]rE[i\PD[i - 1], (23) 
The proposed RALS algorithm consists of using | |151 -( I231 with t = 



{*)i 



^(*)r 



1 , . . . , 7" alternating iterations between the filters sjj ^ [i] and W 
This allows a very fast convergence for the GLRDS scheme and a 
significant reduction of the MSB. To this end, we only need to iter- 
ate l ll5t , the error e'*' [i] and l l21t . The complexity of the proposed 
GLRDS with the RALS algorithm is 0{D'^) to compute W^'[i] 

and 0{D{Id)) to compute sjj l[i]. Since Id is typically very small 
(Id = 2, 3) and the maximum number of iterations T = 2, 3 the 
complexity of the GLRDS with the RALS algorithm is significantly 
lower than the full-rank RLS 1 1 1, the eigen-decomposition methods 
m, the MSWF (U, and the AVF |5|. 



(13) 



Now fixing Sd,b[i] and solving the problem for Wofi], we have 



Wd[i + 1] ^R-^\i]P[i\, 



-laHW, 



(14) 



where the matrix R[i\ = J2Ui A'^'S^t" [l]r[l]r" [l]s'j;l[l] is a 

DxD correlation matrix and P(*)[i] =J2Ui >'''' Sd,b\l]r[l]x"[l] 
is a. D X K cross-correlation matrix. The LS algorithm outlined in 
lllU-l ll4t can be efficiently computed in a recursive fashion with al- 
ternating steps, as will be shown in the next section. 

4. PROPOSED ADAPTIVE ALGORITHMS 

In this section, we present recursive alternating least squares (RALS) 
algorithms. The basic idea of the RALS is to solve the LS expres- 
sions in I ll2t -lll4t via an alternating strategy with t = 1, . . . ,T 
iterations. Using the expressions in ( 112) and the matrix inversion 
lemma [1], we obtain for d, j = 1, . . . , D, b = 1, . . . , B, and 

i = i,...,r 



,Wr 



d,bW[Pd,bm 



j^d 






(15) 



where 



Pd,b[f\ = A-iPd,6[i-l]-A-^fcd,6HC^Wdd,6Pd,4«-l], (16) 



5. SIMULATIONS 

The performance of the GLRDS scheme and RALS algorithms is as- 
sessed via simulations for space-time interference suppression. We 
consider the uplink of a DS-CDMA system with symbol interval T, 
chip period Tc, QPSK modulation, spreading gain A'' = T/Tc, K 
users, and equipped with a uniform antenna array with J elements. 
The spacing between the antenna elements is d = Ac/2, where Ac is 
the carrier wavelength. Assuming that the channel is constant dur- 
ing each symbol and the receiver is synchronized with the main path, 
the received signal after filtering by a chip-pulse matched filter and 
sampled at chip rate yields the M x 1 received vector 

K 

rH = Yl AkXk[i]pM + il[i] + j[i] + n[i], (24) 



where M = J{N + Lp — 1), the complex Gaussian noise vector is 
n\i] = [ni\i] . . . nM\i]f with £[n[i]n-^[i]] = aH. The JLp x 1 
channel vector hk[i] contains the complex gains of the channel from 
user k to each antenna element. The M x 1 spatial signature for 
user k is Pfe[i] = J-khk[i], where J^^ is an M x JLp matrix with 
shifted versions of the signature sequence s^ — [afc(l) . . . ak{N)]'^ 
of user k that performs convolution of the channel hk[i] with Sfc. 
The signatures are randomly generated with A'^ — 16. For the sim- 
ulations, we use the initial values W_d[0] = [1kxiOkxd-i]^ and 
•^DiO] — [Id Odxm-d]^, assume L = 9 as an upper bound, use 
3-path channels with relative powers given by 0, —3 and — 6 dB, 



where in each run the spacing between paths is obtained from a dis- 
crete uniform random variable between 1 and 2 chips and average the 
experiments over 200 runs. The power and the phase of each path 
is time- varying and follows Clarke's model |13|. The system has a 
power distribution among the users for each run that follows a log- 
normal distribution with associated standard deviation equal to 1.5 
dB and there is a sinusoidal jamming signal j[i] with a power level 
20 dB above the average signal-to-noise ratio (SNR) of the users, 
which are jointly demodulated. 

We compare the proposed GLRDS scheme and RALS with the 
Full-rank RLS fT|, the eigen-decomposition (EIG) 13 1, the MSWF 
|4|, the AVF |5|, the JIO |8| and JIDF |9| techniques. We consider 
the MSB performance versus the rank D space-time receivers pro- 
cess r[i] with M — 75 samples per symbol. The results in Fig. |3] 
show that the best rank for the GLRDS scheme is D = 4 (used in 
the next experiments) and that it is very close to the optimal MMSE. 
The results in Fig. |3]show that the best rank for the proposed scheme 
is D = 4 and it is very close to the optimal MMSE. The number of 
elements Id required to construct the decompositions is often small 
( a uniform Id ~ 3 for d = 1, . . . , D is used here throughout) 
and a designer can employ non-uniform lengths according the low- 
rank modelling needs. The number of iterations T is also typically 
small and allows the RALS to converge faster. Our studies with 
systems with different sizes suggest that D is relatively invariant to 
the system size, which brings considerable computational savings to 
the GLRDS scheme and allows a suitable low-rank modelling and a 
very fast convergence performance. In practice, the rank D can be 
adapted in order to account for time- varying scenarios and models, 
ensuring good performance and tracking after convergence. 
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Fig. 4. BER performance versus number of received symbols. Parameters: 

A = 0.999, PdIO] = O.OII, Pj b[0] = O.OII. 



6. CONCLUSIONS 

This work has proposed the GLRDS scheme and the RALS algo- 
rithms for performing low-rank adaptive filtering, and has consid- 
ered their application to space-time interference suppression in DS- 
CDMA systems. The GRLDS scheme provides a way for com- 
puting generalized low-rank signal decompositions with switching 
techniques and adaptive algorithms, which does not require eigen- 
decompositions. The results of simulations show that the proposed 
GRLDS scheme and the RALS algorithms obtain quite significant 
gains in performance over previously reported low-rank schemes. 
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In the next experiment we evaluate the average BER perfor- 
mance against the number of received symbols for the GLRDS and 
RALS, and the existing schemes and algorithms, as depicted in Fig. 
|4] The packet size is P = 1500 symbols and the adaptive filters are 
trained with 200 symbols and then are switched to decision-directed 
mode to continue the adaptation.The results show that the proposed 
GLRDS scheme has a much better performance than the existing 
approaches and is able to adequately track the desired signal. A sta- 
bility and convergence analysis of the proposed scheme based on 
control-theoretic arguments |11, 12 1, including tracking and steady- 
state performance, conditions and proofs are not included here due 
to lack of space and are intended for a future paper 
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